CLAIMS 

1 1 . A computerized method for creating a three dimensional model from one or 

2 more image panoramas, the method comprising: 

3 receiving one or more image panoramas representing a visual scene and having 

4 one or more objects; 

5 determining a directional vector for each image panorama, the directional 

6 vector indicating an orientation of the visual scene with respect to a reference 

7 coordinate system; 

8 transforming the image panoramas such that the directional vectors are 

9 substantially aligned relative to the reference coordinate system; 

10 aligning the transformed image panoramas to each other; and 

1 1 creating a three dimensional model of the visual scene from the transformed 

12 image panoramas using the reference coordinate system and comprising geometry 

13 information describing the one or more objects contained in the scene. 

1 2. The method of claim 1 wherein the directional vector is determined based, at 

2 least in part, on instructions identifying elements of the image panorama received from 

3 a user. 

1 3. The method of claim 2 wherein the instructions from the user identify two or 

2 more substantially parallel features in the image. 

1 4. The method of claim 2 wherein the instructions from the user identify two or 

2 more sets of substantially parallel features in the image. 

1 5. The method of claim 2 wherein the instructions from the user identifying a 

2 horizon line of the image panorama. 

1 6. The method of claim 2 wherein the instructions comprise the identification of 

2 two or more areas of the image, each area containing one or more elements and further 
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3 comprising automatically identifying the two elements contained in the two or more 

4 areas. 

1 7. The method of claim 6 further comprising using edge detection to 

2 automatically identify the two elements. 

1 8. The method of claim 1 wherein the image panoramas are aligned relative to the 

2 reference coordinate system such that the directional vector is at least substantially 

3 parallel to one axis of the reference coordinate system. 

1 9. The method of claim 1 wherein the image panoramas are aligned relative to the 

2 reference coordinate system such that the directional vector is at least substantially 

3 orthogonal to one axis of the reference coordinate system. 

1 10. The method of claim 1 wherein the image panoramas are aligned according to 

2 instructions received from a user. 

1 11. A computerized method of interactively editing objects in a panoramic image, 

2 the method comprising: 

3 receiving an image panorama representing a visual scene, the image panorama 

4 having one or more objects and a point source; 

5 creating a three dimensional model of the visual scene using features of the 

6 visual scene and the point source; 

7 receiving an edit to one or more of the objects in the panorama; 

8 transforming the edit relative to a viewpoint defined by the point source; and 

9 projecting the transformed edit onto the objects. 

1 12. The method of claim 1 1 wherein the three-dimensional model comprises one 

2 or more of depth information and geometry information. 



1 13. The method of claim 11, further comprising receiving an edit to color 

2 information associated with the objects of the image. 

1 14. The method of claim 1 1 , further comprising receiving an edit to alpha information 

2 associated with the objects of the image. 

1 15. The method of claim 1 1 , further comprising receiving an edit to depth information 

2 associated with the objects of the image. 

1 16. The method of claim 1 1 , further comprising receiving an edit to geometry 

2 information associated with the objects of the image. 

1 17. The method of claim 1 1 further comprising: 

2 providing a user with an interactive drawing tool that specifies edits for one or more 

3 objects of the image; and 

4 receiving the edits made by the user using the interactive drawing tool. 

1 1 8. The method of claim 1 7 wherein the interactive drawing tool is one of an 

2 extrusion tool, a ground plane tool, a depth chisel tool or a non-uniform rational B- 

3 spline tool. 

1 19. The method of claim 17, wherein the interactive drawing tool specifies a selected 

2 value for depth for objects of the image. 

1 20. The method of claim 1 7, wherein the interactive drawing tool incrementally adds to 

2 the depth for objects of the image. 

1 21. The method of claim 1 7, wherein the interactive drawing tool incrementally subtracts 

2 from the depth for objects of the image. 



1 22. A method for projecting texture information onto a geometric feature within an 

2 image panorama, the method comprising: 

3 receiving instructions from a user identifying a three-dimensional geometric 

4 surface within an image panorama, the image panorama containing features having 

5 one or more textures; 

6 determining a directional vector from the three-dimensional geometric surface; 

7 creating a geometric model of the image panorama based at least in part on the 

8 three-dimensional geometric surface and the directional vector; and 

9 applying the one or more textures to the features in the image panorama based 
10 on the geometric model. 

1 23. The method of claim 22 wherein the instructions are received using an 

2 interactive drawing tool. 

1 24. The method of claim 22 wherein the three-dimensional geometric surface is 

2 one of a floor, a wall, or a ceiling. 

1 25. The method of claim 22 wherein the directional vector is orthogonal to the 

2 planar surface. 

1 26. The method of claim 22 wherein the geometric model comprises depth 

2 information. 

1 27. The method of claim 22 wherein the texture information comprises color 

2 information. 

1 28. The method of claim 22 wherein the texture information comprises luminance 

2 information. 

1 29. A computerized method for creating a three-dimensional model of a visual 

2 scene from a set of image panoramas, the method comprising: 
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3 receiving multiple image panoramas; 

4 arrange each image panorama to a common reference system; 

5 receiving information identifying features common to two or more of the 

6 arranged panoramas; 

7 aligning the two or more image panoramas to each other using the identified 

8 features; and 

9 creating a three-dimensional model from the aligned image panoramas. 

1 30. The method of claim 29 wherein the instructions are received using an 

2 interactive drawing tool. 

1 31. The method of claim 30 wherein the interactive drawing tool is used to identify 

2 four or more features common to the two or more image panoramas. 

1 32. A system for creating a three dimensional model from one or more image 

2 panoramas, the system comprising: 

3 means for receiving one or more image panoramas representing a visual scene 

4 having one or more objects; 

5 means for allowing a user to interact with the system to determine a directional 

6 vector for each image panorama; 

7 means for aligning the image panoramas relative to each other; and 

8 means for creating a three dimensional model from the aligned panoramas. 

1 33. The system of claim 32, wherein the input images comprise two-dimensional 

2 images. 

1 34. The system of claim 32, wherein the input images comprise three-dimensional 

2 images including geometry information. 

1 35. The system of claim 32 wherein the image panoramas are aligned according to 

2 instructions received from a user. 
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1 36. A system for interactively editing objects in a panoramic image, the system 

2 comprising: 

3 a receiver for receiving one or more image panoramas representing a visual 

4 scene having one or more objects and a point source; 

5 a modeling module for creating a three dimensional model of the visual scene 

6 including depth information describing the objects 

7 one or more interactive editing tools for providing an edit to one or more 

8 objects in the panorama; 

9 a transformation module for transforming the edit relative to a viewpoint 

10 defined by the point source; and 

1 1 a rendering module for projecting the transformed edit onto the objects. 

1 37. The system of claim 36 wherein the one or more editing tools comprises a 

2 ground plane tool, an extrusion tool, a depth chisel tool, and a non-uniform rational B- 

3 spline tool. 
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